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Article history: Research Productivity (RP) is the key element in the establishment of 
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Received Dec 3, 2019 the many initiatives taken to enliven the research culture among academic 

Revised Feb 8, 2020 staff, there are still constraints and resistance towards conducting research. 

Accepted Feb 25, 2020 Therefore, this study attempts to identify the factors affecting RP and 


develop an appropriate model to determine the RP of an academic staff in 





Universiti Teknologi MARA (UiTM). In this study, 5 research related 
Keywords: indicators were used in the determination of RP. Since the population size of 
UiTM is large, the primary data was collected by using questionnaire survey 
and stratified random sampling. The variables that were found to be 
significant in determining RP of an academic staff were age cohort, highest 
Research output qualification, cluster and track emphasis. Satisfaction towards annual KPI, 
Research productivity UiTM current policy and monthly income were also found to influence 
the RP of an academic staff. In addition, perceiving the role of principal 
investigator as a chore and burden and supervising and graduating a PhD 
student perception as burden and pleasure were also found to be affecting 
RP. Using these variables, Logistic Regression Model was used to determine 
the RP of an academic staff in UiTM. In conclusion, personal, environmental 
and behavioural factors were found to have influence on the RP among 
academic staff of UiTM. Therefore, generally it is possible to maximize 
the RP of academic staff by identifying the factors influencing RP followed 
by strategic management and proper monitoring system. 
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1. INTRODUCTION 

Despite of the criticisms on the numerous variation in university ranking system, these systems still 
plays a major role in the HE sector. The most compelling evidence is that these ranking systems had 
a transformative impact and influence on HE sector and its stakeholders around the world like students and 
parents, governments and policymakers, employers and industry, peer institutions and research partners, 
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philanthropists and alumni to access a specific university’ ranking and rating in various purposes [1]. Two (2) 
of the most known ranking system are namely Academic Ranking of World Universities (ARWU) and World 
University Rankings (WUR), being the obsession of 17,000 Higher Education Institutions (HEIs) worldwide 
to be ranked in the top 100 as stated by [2]. On the institutional perspective however, these ranking platforms 
had indirectly created a healthy competition among all the HEIs in Malaysia in competing to fulfil the criteria 
of being recognized as Research University (RU). In addition, the Malaysian government had also allocated 
a large amount of fund to support the RU to continuously produce innovations and quality research 
outputs [3]. These systems had encouraged HEIs to set strategic goals, strengthen their research capability 
and intensify their productivity [4]. Research element is the most common shared criteria used among 
ranking and rating instruments. In United Kingdom (UK), according to Research Excellence Framework 
(REP) [5], HE funding bodies developed the REF for research assessment that is to secure the continuation of 
a world-class, dynamic and responsive research base across the full academic spectrum within UK HE. 
Similarly, in Malaysia, the Ministry of Higher Education (MOHE) implemented Malaysia Research 
Assessment (MyRA), an instrument to assess research, development and innovation activities in all 
universities. In align, the use of Key Performance Indicator (KPI) in HE ensure that academic staff are 
producing output to enhance their visibility as well as for the institution. The most common KPI set by HEIs 
are the number of scholarly publication produced annually. To clarify that, there has been numerous studies 
in measuring RP with the use of scholarly publication being the top indicator [6-9]. Other research related 
indicators should also be included in measuring RP to encourage academic staff to conduct research. 
Personal factor are commonly used in measuring RP whereby variables such as age, experience and level of 
qualification has been reported to have strong correlation with RP [6, 8-10]. Environmental factor including 
research culture, workload, research assistance and research funding are also important to be considered in 
RP. Workload affects RP as it controls the ability for the academic to do research [9, 10]. Research funding is 
one of the essential components to aid researchers in doing research as well as producing 
outputs [6, 9, 11, 12]. Management factor are related to the policies and KPI that is usually set by 
the institution as it is the goal that the institution strives to achieve. The use of performance indicators for 
HEI is needed to improve accountability of HEI [13]. Lastly, behavioural factor include variables like 
motivation, incentive, promotion and recognition. The lack of these variables had demotivated young 
researchers to do research, which indicates that behavioural factors also affect RP. In fact, human behavioral 
aspects were also found to be a factor in a study conducted by Mokhtar and Noordin [14]. Numerous studies 
have shown that motivation to do research has a significant correlation with RP [15-21]. Based on a study 
conducted in Binus University, Indonesia, the emphasis on research publications in KPI from the higher 
management motivates academic staff to do research as well as increasing RP [8]. On the other hand, logistic 
regression is widely used in various fields and sectors, including predicting staff performance in 
an organization. In a study conducted by Francis [22], marital status was found to be a significant factor in 
distinguishing staff performance as identified from the outlined factors influencing the staffs’ performance in 
a selected small public sector. Yaacob et al. [23] also used logistic regression as one of the techniques to 
determine as well as to predict UiTM undergraduate student’s performance which is said to be beneficial for 
innovation in modern educational systems. Being said that logistic regression model is used in various fields 
and sectors, Samsudin et al. [24] had proposed an enhancement features to detect YouTube spam which 
includes logistic regression as one of the tools of comparision. Based on a study conducted in UiTM by 
Henry et al. [11] which investigated the relationship between research funding and the citation impact of 
UiTM’s research publications, it was found that financial support from funding bodies in terms of research 
grants is acknowledged as a factor which can influence overall impact and number of times a publication is 
cited. Moreover, scholarly publication is often being used to measure the productivity of an institution and 
has been recognized worldwide as a medium through which to expand the social and the knowledge 
economy. Up until today, there is no standard measurement to determine RP of an institution. 
Dhillon et al [6] conducted a study which identifies the factors associated with scholarly publication. 
However, this paper emphasis not only the number of publications but also other indicators such as 
the amount of research grant acquired, the status of the principal investigator, number of PhD students 
graduated, and the number of intellectual properties registered were also taken account in measuring RP. 
These criteria are based on the criteria in MyRA’ Instrument that yields a large proportion of marks and also 
align with the world ranking and rating systems such as QS Ranking and THE. This paper presents the effect 
of personal, environmental, management and behavioural factors on the RP of an academic staff by the use of 
logistic regression model to determine the RP of an academic staff. 
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2. RESEARCH METHOD 


2.1. Framework 

Only academic staff of UiTM which are located in Selangor campuses were selected for this study 
in align with the university ranking and rating system practices. A previous study was conducted in 
Universiti Teknologi Malaysia (UTM) that studied the association of personal, environmental and 
behavioural factors with scholarly publication [6]. However, in this case of UiTM, an additional factor was 
added to the framework that is management factor as shown in Figure 1. Management factors consists of 
publication KPI, KPI weightage, rewards or incentives, and reviewing process. The need of this factor is 
necessary as KPI based outcomes is now being used to measure annual performance of an academic staff. 
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Figure 1. Theoretical framework as adapted from Dhillon et al [6] 


2.2. Determination of Research Productivity 

Figure 2 shows the flowchart to determine the RP of each academic staff. Five (5) criteria were used 
to determine the status of an academic staff which were the amount of research grant acquired, status of 
principal investigator, number of publication, number of PhD graduates and number of intellectual property. 
Each criteria required either a yes or no, hence as long as an academic fulfils any 1 out of the 5 criteria, 
the academic is considered to be productive. 
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Figure 2. Research productivity determination flowchart 
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2.3. Logistic regression 

Logistic regression is widely used in various fields and sectors, commonly for dichotomous 
dependent variables. In the HE sector, there have been several studies on applying logistic regression to 
address student enrolment and retention. This approach was found to be imperative in maintaining and 
improving the enrolment rate in the future [25]. The objective of the model proposed herein is to determine 
the conditional probability of a specific academic staff belonging to a status (productive or non productive), 
given the values of the independent variables of that academic staff. For this study, the logistic regression 
was used to model the event Y=1 (productive). 





P(Y=1) 
log (725) = © + BX + BX + BaXs + Bae í) 
1 

BS Gea Q) 
Where 
P(Y =1) = the probability of being productive 
Z = a+ BX, + P2X2 + B3X3 + b4X4 
a = Constant 

= Personal Factor 

By Pi 1F 
Bo = Environmental Factor 
b3 = Management Factor 
pa = Behavioural Factor 


2.4. Data collection 
2.4.1. Sampling design 

Based on a similar studies conducted in identifying factors associated with RP, Sulo, Kendagor, 
Kosgei, Tuitoek and Chelangat [9] used a combination of stratified and simple random sampling while 
Wichian, Wongwanich and Bowarnkitiwong [10] used only simple random sampling. These studies were 
found to obtain the most reasonable number of respondents suitable with the size of UiTM. Hence, stratified 
random sampling were used in this study to calculate the number of respondents. UiTM consists of 27 
faculties, Fn, in which divided into 2 status that is productive and non productive as in Figure 3. 
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Figure 3. Population of UiTM by RP status 


This study focused on these 2 status of which contain the 27 faculties. Hence, stratified random 
sampling was utilised to determine the approximate number of sample size required as in (3) [26]. 


Niet N20% i 
n= -Wr Wa where, D = (a (3) 
N*“D+N 07, +N 205 Za 
2 
Where: 

n = Number of samples 
N = N, +N, 
N, = Number of sampling units in the population for stratum productive 
N, = Number of sampling units in the population for stratum non productive 
o? = Population variance for stratum productive 
of = Population variance for stratum non productive 
ô = Sample statistic 
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W, = Weightage for h = 1,2 
z Za (Proportional allocation) 
d = Bound on the error of estimation 
Zase (Ô) 
Z 


Table 1 shows the number of academic staff by status and the number of respondents gathered from 
the pilot study. Based on the pilot study, mean and standard deviation for each factor was retrieved as 
presented in Table 2. 


Table 1. Weightage of academic staff 








Status No. of Academic Staff, N; Number of Respondents, n; Weightage, W, 
(1) 2,015 32 0.5351 
(2) 1,751 10 0.4649 





Note: (1) = Productive 
(2) = Non rpoductive 


Table 2. Mean and standard deviation by factor and status 








Factor Status Mean Standard Deviation, of 
Environmental (1) 3.4903 0.9049 

(2) 3.6644 0.5386 
Management (1) 3.1692 0.7383 

(2) 2.9000 0.6976 
Behavioural (1) 3.6099 0.7551 

(2) 3.3444 0.8527 





The number of sample size is then calculated based on factor and the highest number is selected for 
this study as summarized in Table 3. However, the research nature in UiTM varies according to faculty as 
Science and Technology (S&T) based faculties are more likely to do research compared to Social Sciences 
(SS) based faculties. Hence, 456 respondents were selected from S&T based faculties while another 456 
respondents were selected from SS based faculties. In this study, track emphasis of the academic staff was 
also taken into account as the number of respondents were selected proportionally from the population as 
summarized in Table 4. 


Table 3. Summary of sample size determination by factor 
Status Environmental _ Management Behavioural 








() 211 244 234 
2) 184 212 204 
Total 395 456 438 





Table 4. Sample size for S&T and SS based faculties 








S&T SS 
Status Track No. of No. of No. of No. of Respondent 
Academic Staff Respondent Academic Staff : 

1 TL 893 161 458 169 
0) TL 460 83 204 75 
Q) TL 636 185 871 181 
TL 93 27 151 31 

Total 2.082 456 1.684 456 





2.4.2. Primary data and sources 

Primary data was collected by conducting a survey using an adapted questionnaire. Meanwhile, 
secondary data was collected from UiTM’s Institute of Research Management and Innovation (IRMI) such as 
the amount of research grant acquired, the status of the principal investigator, the number of publications, 
number of PhD students graduated, and number of intellectual property registered for the year of 2016. 
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3. RESULTS AND DISCUSSION 

Omnibus Test was used to evaluate the significance of the logistic regression model. Based on 
the result in Table 5, the p-value is less than 0.05 indicating that the model is significant. Hosmer and 
Lemeshow test was used to assess the relationship between observed and predicted probabilities match as 
previously demonstrated by Salkind [27]. It was found that the model is not significant (Table 6), indicating 
that logistic regression model fits the data. The Nagelkerke R Square shows that 46% of the variation in 
the outcome variable (Productive) is explained by this logistic model as in Table 7. From the classification 
percentage in Table 8, the percentage of correct classification is 78.2% which is considered to be good as 
many studies havefound that the classification percentage above 70% is acceptable [28]. 


Table 5. Omnibus test 











Chi-square df p-value 
266.867 85 0.000* 
Note: *Significance level based on 0.05 


Table 6. Hosmer and Lemeshow test 
Chi-square df p-value 
5.000 8 0.758 











Table 7. Variation explained by the model 
-2 Log likelihood Cox & Snell R Square Nagelkerke R Square 
595.442 0.338 0.459 











Table 8. Classification results for logistic regression model 








Predicted 
Observed erates Percentage Correct 
Non productive Productive 8 
F 169 80 
Non productive (67.9%) (32.1%) 67.9 
RP 

Productive Sl oe 84.7 

(15.3%) (84.7%) i 
Overall percentage 78.2 





The odds ratios can be further explained using the value of Exp(B) in Table 9. In this study, 
academic staff who have a doctoral degree were 7 times more likely to be productive compared to those with 
professional qualification. In addition, academic staff who perceive supervision and producing a PhD 
graduate as a burden were 11 times more likely to be productive compared to those who perceive otherwise. 
It is found that this category of productive researchers produce scholarly outputs as a joint output with their 
postgraduate students at the same time fulfilling the requirements of the doctoral degree. This is in agreement 
with the high ratios of graduate students to academic staffs correlate with RP [7, 29]. Either way, both 
the academic staff and student would benefit from this and increases the institution’s RP. This model can also 
be used to predict the RP of an academic staff by using the contributing factors (significant covariate) that 
influences the RP of academic staff. In a situation of an academic staff aged below 40 years old, owns 
a doctoral degree, belong to a S&T based faculty, choses TL, and is satisfied with his annual KPI, UiTM’ s 
policy, monthly income and agrees that leading a research project, publishing and supervising and graduating 
a PhD student is a chore and pleasure and strongly disagree that leading a research project, publishing and 
supervising and graduating a PhD student is a burden, the z value is as presented in (4). 


z = 0.447+1.181+2.012+0.77-0.822-1.114 = 2.474 
Thus, the probability of being productive for this academic staff is formulated by (4). 


P(productive) = a = 0.922 (4) 


The probability of this academic staff being classified as productive is 0.922 indicating that 
the likelihood of being productive is high. Based on this finding, higher management can groom this 
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academic staff into becoming a well-known researcher in the future by giving support in term of internal 
grants, incentives and so on. 


Table 9. Parameter estimates and test statistics 














Factor Variable B S.E. Wald df p-value Exp(B) 
Personal Age Cohort 
Less than 40 years old 1.181 0.569 4.301 1 0.038* 3.257 
Highest Qualification 
PhD 2.012 0.517 15.129 1  0.000* 7.471 
Cluster 
S&T 0.770 0.240 10.261 1  0.001* 2.159 
Lecturer Track Assignment Emphasis 
Teaching and Learning -0.822 0.314 6.856 1 _ 0.009* 0.439 
Environmental Are you satisfied with the annual KPIs to be achieved? 
Absolutely not satisfied -2.678 1.342 3.981 1 0.046* 0.069 
Not satisfied -1.883 0.848 4.933 1  0.026* 0.152 
Neutral -2.615 0.769 11.579 1 0.001* 0.073 
Are you satisfied with UiTM’s current policy on job 
scope? 
Not satisfied 2.129 0.969 4.821 1  0.028* 8.402 
Are you satisfied with your monthly income? 
Absolutely not satisfied -3.041 1.048 8.419 1 0.004* 0.048 
Behavioural Do you feel that leading a research project is a chore? 
Strongly Disagree -2.827 1.305 4.696 1 0.030* 0.059 
Do you feel that leading a research project is a burden? 
Agree -2.189 0.770 8.083 1  0.004* 0.112 
Neutral -2.318 0.718 10.428 1  0.001* 0.098 
Disagree -1.485 0.657 5.109 1  0.024* 0.226 


Do you find that supervising and graduating a PhD 
student is a burden? 


Agree 2.417 0.710 11.609 1 0.001* 11.217 
Neutral 2.088 0.669 9.727 1 0.002* 8.068 
Disagree 1.859 0.615 9.133 1 0.003* 6.420 


Do you find that supervising and graduating a PhD 
student is a pleasure? 
Agree -1.114 0.510 4.779 1 _0.029* 0.328 





Constant 0.447 1.515 0.087 1 0.768 1.564 





Based on this study, age is one of the variables that were found to be affecting RP of an academic 
staff which validate the study conducted by Dhillon, Ibrahim and Selamat [6] and Wichian, Wongwanich and 
Bowarnkitiwong [10]. Academic staff who age cohort is less than 40 years old are considered to be young 
researcher who is the research leader in the future. Hence, these young researchers need to be groomed by 
giving awards and recognitions to motivate them to do more research and eventually increasing their own 
university’s RP. In addition, possession a doctoral degree also influence the RP of an academic staff which 
support the findings for studies conducted by Nurhudatiana and Anggraeni [8] and Sulo, Kendagor, Kosgei, 
Tuitoek and Chelangat [9]. Other personal factor that were found to be affecting RP are cluster and track 
emphasis. As for the environmental factor, it was found that academic staff who are absolutely satisfied with 
their annual KPI and monthly income are more likely to be productive. However, it is found to be the reverse 
with UiTM’s current policy on their job scope satisfaction as academic staff who are not satisfied are more 
likely to be productive. This shows that academic staff still perform in research regardless of the policy set by 
the higher management. In this study, an additional factor was added that is management factor. 
Unfortunately, all the variables are not significant indicating that management factor do not influence the RP 
of an academic staff. In the context of perception towards leading a research project, academic staff who 
positively perceive that leading a research project are more likely to be productive. In contrast, academic staff 
who less positively perceive that the act of supervising and graduating a PhD student are more likely to be 
productive. In achieving the KPI set by the higher management, academic staff especially has to face with the 
heavy workload which is disproportionate with their effort spent and benefit received in fulfilling every 
components of the required research related achievement [30]. As a matter of fact, workload directly affects 
RP as it controls the ability for the academic staff to do research [9, 10]. Correspondingly, this also 
demotivates academic staff to conduct research as to steer the university towards achieving its research 
agenda. Academic staff should feel that research is embedded in their job scope as it opens up to new 
opportunities in any form. In fact, the university should conduct a focus group study to find a solution in 
order to make research as a part of their daily routine as an academic staff. 
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4. CONCLUSION 

This paper presents the influence of personal, environmental, management and behavioural factors 
on RP among academic staff in UiTM by using logistic regression model to determine the RP of an academic 
staff. Up to date, there is no standard measurement to determine RP of an institution. However, scholarly 
publication is commonly used in measuring productivity of an institution and is recognized worldwide as 
a medium through which to expand the social and the knowledge economy. Given that, this paper emphasis 
not only the number of publications but also other indicators such as the amount of research grant acquired, 
the status of the principal investigator, number of PhD students graduated, and the number of intellectual 
properties registered were also taken account in measuring RP. These criteria are based on the criteria in 
MyRA’ Instrument that yields a large proportion of marks and also align with the world ranking and rating 
systems such as QS Ranking and THE. From this study, RP of academic staff is influenced by personal, 
environmental and behavioural factors. This study managed to provide an insight of factors that affect RP 
among academic staff in UiTM. Proper management and monitoring of the performance of academic staff 
should be implemented in every HEIs so that the culture of research continues to expand. Being that, 
a Logistic Regression model to calculate individual RP has been built to facilitate the higher management in 
identifying the probability of an academic staff being productive. Research output can be done in many 
aspects not just in scholarly publication. In fact, these outputs are related to one another. The role of research 
is related to the job scope of an academic staff regardless of their preference in teaching or administration. 
Hence, academic staff should feel that research is a part of their career pathway. 
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